Papers with Common European Framework
Using Multilingual Resources to Evaluate CEFRLex for Learner Applications (2020.lrec-1)
Copied to clipboard
| Challenge: | The Common European Framework of Reference for Languages defines six levels of learner proficiency and links them to particular communicative abilities. |
| Approach: | They propose to compile lexical resources that link single words and multi-word expressions to specific CEFR levels. |
| Outcome: | The results show that the English CEFRLex resource is in accordance with external resources that are gold standard. |
Jump-Starting Item Parameters for Adaptive Language Tests (2021.emnlp-main)
Copied to clipboard
| Challenge: | Prior work has addressed ‘cold start’ estimation of item difficulties without piloting, but a multi-task generalized linear model with BERT features is needed to jump-start new items without pilot. |
| Approach: | They propose a multi-task generalized linear model with BERT features to jump-start new item difficulties without piloting them first. |
| Outcome: | The proposed model compares test-taker proficiency, item difficulty, and language proficiency frameworks like the Common European Framework of Reference (CEFR). |
Standardize: Aligning Language Models with Expert-Defined Standards for Content Generation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Domain experts in engineering, healthcare, and education follow strict standards for producing quality content. |
| Approach: | They propose a retrieval-style in-context learning-based framework to guide large language models to align with expert-defined standards. |
| Outcome: | The proposed framework shows that models can gain 45% to 100% increase in precise accuracy across open and commercial LLMs evaluated. |
An SLA Corpus Annotated with Pedagogically Relevant Grammatical Structures (L18-1)
Copied to clipboard
| Challenge: | a study using a framework to evaluate a language learner's proficiency in a second language aims to examine the production of learners with pedagogically relevant grammatical structures . |
| Approach: | They annotated texts produced by language learners with grammatical structures . they found that learners from different proficiency levels use pedagogically relevant structures compared to those of already certified language learners . |
| Outcome: | The annotated resource SGATe analyzes texts produced by language learners with grammatical structures . structure evolution along levels and level in which they are used the most was studied . |
Language Proficiency Scoring (2020.lrec-1)
Copied to clipboard
| Challenge: | a new paper evaluates and extends the results of an automated proficiency classification system for different languages. |
| Approach: | They propose to extend an automated essay scoring system proposed by CEFR . they compare results with those from previous paper and add a new corpus for english . |
| Outcome: | The proposed approach does not scale well with the added English corpus. |